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DETAILED ACTION 

Information Disclosure Statement 

1 . An initialed and dated copy of Applicant's IDS forms 1449, Paper No. 20040621 
and 20040622, are attached to the instant Office action. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

3. Claims 1-2, 4, 6-7, 15,17, 20-22, 24, 26-27, 37-38, 40, and 42 are rejected under 
35 U.S.C. 102(e) as being anticipated by Lui et al. (US 6,778,815). 

Regarding claim 1 , Lui discloses a system and method for accepting disparate 
types of computer user input (claims 1 and 9) comprising a text input panel accepting 
soft keyboard (abstract; Fig. 4-411, Fig. 8, Fig. 11, Fig. 12, Fig. 15, Fig. 19, Fig. 22, Fig. 
23, and Fig. 24) and a text recognizer/synchronizer recognizing and preserving an order 
in which the user inputs text via the speech recognizer, the handwriting recognition, and 
the soft keyboard (abstract; Fig. 3-310, claim 2). 



♦ 
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Regarding claims 2, 4, and 15, Lui discloses a character recognizer (Fig. 3-304) 
that recognizes various strokes or gestures as abbreviations for certain characters or 
special symbols (col. 7, lines 22-25). 

Regarding claim 6, Lui discloses a symbol pad, a character recognition pad, and 
a gesture pad that a user's inking or gestures can be interpreted as a gesture opposed 
to a symbol or other character (col. 7, lines 44-48). 

Regarding claim 7, Lui discloses that a Tablet PC user interface accepts a 
spectrum of input ranging from entering characters via a simple virtual keyboard through 
a single stroke or single character recognition (col. 5, lines 27-40). 

Regarding claim 17, Lui discloses a text recognizer/synchronizer recognizing and 
preserving an order in which the user inputs text via the speech recognizer, the 
handwriting recognition, and the soft keyboard (abstract; Fig. 3-310, claim 2). 

Regarding claim 20, Lui discloses that the user interface includes a keybar or 
keypad having at least one key selected from the group consisting of left arrow, right 
arrow, backspace, delete, space, end, home, enter, tab, and escape. 

Regarding claim 21, claim 21 is analogous and corresponds to claim 1. See 
rejection claim 1 for further explanation. 

Regarding claims 22, 24, and 26 is analogous and corresponds to claims 2 and 
4. See rejection of claims 2, 4, and 15 for further explanation. 

Regarding claim 27, Lui discloses a keyboard tab (Fig. 4-402) that, when 
selected, activates a soft keyboard (Fig. 4-411) for accepting soft keyboard presses 
including alphabets (claim 16). 
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Regarding claim 37, Lui discloses a system and method for accepting disparate 
types of computer user input (claims 1 and 9) comprising a text input panel accepting 
soft keyboard (abstract; Fig. 4-411, Fig. 8, Fig. 11, Fig. 12, Fig. 15, Fig. 19, Fig. 22, Fig. 
23, and Fig. 24) and a handwriting recognizer for recognizing handwritten text input by a 
user via the handwriting recognition area (claim 1), and a text recognizer/synchronizer 
recognizing and preserving an order in which the user inputs text via the speech 
recognizer, the handwriting recognition, and the soft keyboard (abstract; Fig. 3-310, 
claim 2). 

Regarding claim claims 38, 40, and 42, Lui discloses a character recognizer (Fig. 
3-304) that recognizes various strokes or gestures as abbreviations for certain 
characters or special symbols (col. 7, lines 22-25). 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 3, 8-10, 23, and 39 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Lui et al. (US 6,778,81 5) in view of Zhai et al. ("Performance 
Optimization of Virtual Keyboards"). 
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Regarding claim 3, Lui discloses all the claim limitations of the previous claim 
except the claim limitation of claim 3. However, Zhai teaches Fitts-Digraph Model of 
Virtual Keyboard using distance of one key to another (pages 93-94) 

It would have been prima facie obvious to one of ordinary skill in the art at the 
time the invention was made to use Zhai's method in Lui's invention to enhance the 
usability and acceptability of virtual keyboards as suggested by Zhai (page 123). 

Regarding claim 8, Zhai further teaches an alphabetical tuning depending on the 
place in the alphabet for the character and on its position of the keyboard (pages 110- 
113). 

Regarding claim 9, Zhai further teaches an equation for alphabetical tuning that 
has an empirically adjusted weighting coefficient (page 112). 

Regarding claim 10, Zhai further teaches a Fitts-Digraph Model that has a given 
distance-Dij, which is between one key i to another j (page 93). 

Regarding claim 23, claim 23 is analogous and corresponds to claim 3. Refer 
rejection of claim 3 for further explanation. 

Regarding claim 39, Lui discloses all the claim limitations of the previous claim 
except the claim limitation of claim 39. However, Zhai teaches Fitts-Digraph Model of 
Virtual Keyboard using distance of one key to another (pages 93-94) 

It would have been prima facie obvious to one of ordinary skill in the art at the 
time the invention was made to use Zhai's method in Lui's invention to enhance the 
usability and acceptability of virtual keyboards as suggested by Zhai (page 123). 
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6. Claims 5, 16, 19, 25, 28, and 41 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Lui et al. (US 6,778,815) in view of Carman, II (US 5,454,046). 

Regarding claim 5, Lui discloses all the claim limitations of the previous claim 
except the claim limitation of claim 5. However, Carman discloses that the handwriting 
recognition system offers the user an interface that allows him/her to train the 
recognition database on individual characters or character sequences in the context of 
complete words (col. 3, lines 33-37). 

It would have been prima facie obvious to one of ordinary skill in the art at the 
time the invention was made to use Carman's invention in Lui's invention to provide 
handwritten data readable and reproducible by the computer as suggested by Carman 
(col. 2, lines 20-23). 

Regarding claim 16, Carman further discloses that an abbreviated Chinese 
handwritten entry can be trained for recognition (abstract). 

Regarding claim 19, Carman further discloses that the CPU searches memory 
data storage for a pattern match with the text/pattern pairs stored as class node, word 
node, and pattern node, which is a feature vector (Fig. 3B-90, col. 10, lines 45-49). 

Regarding claim 25, claim 25 is analogous and corresponds to claim 5. Refer 
rejection of claim 5 for further explanation. 

Regarding claim 28, claim 28 is analogous and corresponds to claim 16. Refer 
rejection of claim 16 for further explanation. 

Regarding claim 41, Lui discloses all the claim limitations of the previous claim 
except the claim limitation of claim 41 . However, Carman discloses that the handwriting 
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recognition system offers the user an interface that allows him/her to train the 
recognition database on individual characters or character sequences in the context of 
complete words (col. 3, lines 33-37). 

It would have been prima facie obvious to one of ordinary skill in the art at the 
time the invention was made to use Carman's invention in Lui's invention to provide 
handwritten data readable and reproducible by the computer as suggested by Carman 
(col. 2, lines 20-23). 

7. Claims 11-14, and 18 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Lui et al. (US 6,778,815) in view of Zhai et al. ("Shorthand Writing Stylus 
Keyboard"). 

Regarding claim 1 1 , Lui discloses all the claim limitations of the previous claim 
except the claim limitation of claim 1 1 . However, Zhai teaches a SHARK recognition 
system based on the classic elastic matching algorithm that computes the minimum 
distance between two sets of points by dynamic programming (pages 99-100). One set 
of points is from the shape that a user produces, and the other is from a prototype that 
is the ideal shape defined by the letter key positions of a word (page 100). 

It would have been prima facie obvious to one of ordinary skill in the art at the 
time the invention was made to use Zhai's method in Lui's invention to provide a 
feasible pattern recognition method as suggested by Zhai (page 99). 
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Regarding claim 12, Zhai further teaches that a preprocessing, filtering and 
normalization in scale, is performed before the elastic matching between the unknown 
shape and the prototypes (page 100). 

Regarding claims 13 and 14, Zhai further teaches that the ambiguity of the 
SHARK recognition can be resolved by two approaches (page 100). First one is using 
the transient pie menus (Fig. 4), and the second one is checking the start position or 
the geometric center of the sample relative to the letters defining the multiple 
ambiguous prototypes to determine which word the user intends to write (page 100). 

Regarding claim 18, Zhai teaches a SHARK recognition system based on the 
classic elastic matching algorithm that computes the minimum distance between two 
sets of points by dynamic programming (pages 99-100). One set of points is from the 
shape that a user produces, and the other is from a prototype that is the ideal shape 
defined by the letter key positions of a word (page 100). A preprocessing, filtering and 
normalization in scale, is performed before the elastic matching between the unknown 
shape and the prototypes (page 100). 

8. Claims 29-36 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Lui et al. (US 6,778,815) in view of Milewski et al. ("Medical Word Recognition Using a 
Computational Semantic Lexicon"). 

Regarding claim 29, Lui discloses all the claim limitations of the previous claim 

except the claim limitation of claim 29. However, Milewski teaches a recognition 

method for pattern recognition involving lexicon (abstract). 
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It would have been prima facie obvious to one of ordinary skill in the art at the 
time the invention was made to use Milewski's method in Lui's invention to provide a 
hybrid semantic network as suggested by Milewski (page 402). 

Regarding claims 30 and 36, Milewski further teaches that the recognition 
method deals with medical forms that contain lots of medical words (pages 401-402). 

Regarding claim 31, Milewski further teaches that a lexicon database will contain 
a list of English and medical words which are weighted according to the popularity of 
that word over time (page 402). 

Regarding claim 32, Milewski further teaches that a priori data will be used for 
further recognition in the larger handwriting regions (page 402). 

Regarding claim 33, Milewski further teaches a recognition method for pattern 
recognition of the medical field (abstract). 

Regarding claim 34, Milewski further teaches a data complier, a graphic user 
interface (GUI), and a Java Constrained Object Inference Net (page 402). 

Regarding claim 35, Milewski further teaches that the objective and comments 
region contain lots of varying abbreviations, symbols, and numbers in conjunction with 
regular handwriting, and a general path can be used to narrow in on specific problems 
(page 402). 

Conclusion 

9. No claims are allowed. 
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1 0. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to John Wahnkyo Lee whose telephone number is (571 ) 
272-9554. The examiner can normally be reached on Monday - Friday (Alt.) 7:30 a.m. - 
5:00 p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jingge Wu can be reached on (571 ) 272-7429. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-91 99 (IN USA OR CANADA) or 571 -272-1 000. 



John W. Lee 

(AU 2624) 
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